L Number 


Hits 


Search Text 


DB 


Time star.. 


A 
1 


\ \)( y 


residue near caicuidw>t 


UOrn 1 , 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 




Z 


z 


raciWiia near /"ioIoi 1 1 0. f^/l c a m 0 nrimo noar intonar 
ICoIUUc ileal UdlOUIaw>H bdlllc pi Milt; Ileal lillcyci 


UOrn I , 

1 R-Pf^Pl IR* 

EPO; JPO; 

DERWENT; 

IBM_TDB 


^UUH/UO/ I I IZ.ZD 


o 


ZU*f 


racial ia oorM^ /^Amnnnonl mo ^nrio 

resiaue same component same coue 


UOrn 1 , 








1 I^n Pf"iPl IR- 

EPO; JPO; 

DERWENT; 

IBMJTDB 




A 
H 


0 
0 


resiuue same componeni sdme L-oae ana u&er auj iu 


1 ICPAT' 
UOrn 1 , 


9nn4/rn/i 1 19-9R 






US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 




c 
0 


0 


resiaue same componeni same coae ana user auj 
identification 


1 I^PAT- 
UOrn 1 , 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBMJTDB 


onnA/n^/A 1 19-9A 


O 


z 1 


resiuue same caicuiaicp^t same component same coue 


1 I^PAT- 
UOrn 1 , 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 




-7 


0 
0 


resiuue same caicuiaivp*+ same user near iu 


1 I^PAT- 
UOrn 1 , 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


9nnd/n^/i 1 1^?1 

tUU*t/UO/ II IO.O I 


Q 

O 


c 

0 


near nnor in como hoc h camo / omhoHH^ 0 r VA/^ito rm 0. rl^ \ 

user near iu same nasn sdrne ^einueu^o or wdieniidKs^ 


1 I^PAT 
UOrn i p 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


9nn4/n?/i 1 1??9 


y 




■ i^nr nnnr 1 r\ coma /amkaHC^ r \»/^torrviorl/^ 

user near iu same ^emueacpo or waiermarKj 


1 l<"5PAT 
UOrn 1 , 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


9nn4/rn/i 1 

^UUM/UO/ I I I0.0O 


■1 n 


1 0 


user near iu same ^emueuvpo or waiermarKj ana prime 


1 I^PAT- 
UOrn 1 , 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


9nn4/n^/i 1 1^49 


1 1 
1 1 




user near iu same ^converup**' or nasn^p'+j 


1 IQPAT- 
UOrn 1 , 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 






18 


u«spr npar ID wmp frnn\/prt$4 or hashS>4^ same embed3>4 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/11 13*48 



Search History 3/1 1/04 2:22:52 PM Page 1 
C:\APPS\EAST\Workspaces\09658565.wsp 



1 *5 
1 0 


iuo 


near nA<ar 1 [""^ oomo omhorlt^ coma / i m O n ^ rtr r^nntant\ 

user near iu same emueu^pn same (jmage or content^ 


i ic;pat- 

UOrn 1 , 

1 1^ Pf^PI IR- 

EPO; JPO; 

DERWENT; 

IBMJTDB 


zuu4/u o7i i i o. oy 


14 


AH 
4U 


i icor noor 1 camfi />^r\\/Qr+<Cy1 coma H i n if o 1 

user near iu same converupn same digital 


UOrn t , 


ZUU4/U0711 14.UU 






US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBMJTDB 




lo 


Oft 


residue near caicuiaicp4 same prime 


US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 




ID 




71^/1 7fi 
/ 1 Oil fO 


1 lODAT- 

UorM 1 , 

US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


ZUU4/U07 II 1 4.Z 1 


4 7 

1 / 


40/ 


71 "3/1 7ft orsrl IR 

/ 1 o/n f o ana iu 


US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


onn^/m/1 1 i/i-oi 

ZUU4/U07 M 14.ZI 




33 


713/176 and ID same convertS4 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/11 1422 



Search History 3/1 1/04 2:22:52 PM Page 2 
C:\APPS\EAST\Workspaces\09658565.wsp 



9 



United States Patent m 

Yoshida et al. 



US005583941A 
[ii] Patent Number: 
[45] Date of Patent: 



5,583,941 
Dec. 10, 1996 



[54] IMAGING PROCESSOR 

[75] Inventors: Eiichi Yoshida, Toyokawa; Yoshikazu 
Ikenoue, Toyohashi; Keiji Nakatani, 
Toyokawa, all of Japan 

[73] Assignee; Minolta Co., Ltd., Osaka, Japan 

[21] Appl. No.: 326,002 

[22] Filed: Oct 19, 1994 

[30] Foreign Application Priority Data 

Oct 20, 1993 [JP] Japan 5-262284 

[51] Int. CL 6 - H04L9/08 

[52] U.S. CI 380/51; 380/18; 380/55; 

380/21 

[58] Field of Search 380/18, 51, 55, 

380/21 

[56] References Cited 

U.S. PATENT DOCUMENTS 

4,835,713 3/1989 Pastor 380/51 

4,949,381 8/1990 Pastor 380/51 

5.189.292 2/1993 Battennan et al 380/51 

5.253.293 10/1993 Shigemitsu et al 380/18 

5,255,106 10/1993 Castro : 380/18 

5,337,361 8/1994 Wang et al 380/51 

5,351,136 9/1994 Wuetal 380/18 

5,398,283 5/1995 Virga 380/18 

5,420,922 5/1995 Lunblad et al 380/18 

5,490,217 2/1996 Wang et al 380/51 

5.491,563 2/1996 Pomeranz 380/18 



FOREIGN PATENT DOCUMENTS 

0396774 11/1990 European Pat Off. . 
2-214264 8/1990 Japan . 
3-85872 4/1991 Japan . 

OTHER PUBLICATIONS 

"DCT Image coding using Adaptive Quantization Applica- 
tion to Digital Color Copiers," Kazuyuki Murata, Gazou 
Denshi Gakkaishi, vol. 10, No. 5 (1991) pp. 467-475. 

Primary Examiner— Salvatore Cangialosi 

Attorney, Agent, or Firm — Brinks Hofer Gilson & lione 

[57] ABSTRACT 

In an image processor, a scramble device performs scramble 
processing to deform a document image by using scramble 
conditions by rearranging pixel data in the document image 
read by a reader. The scramble conditions are embedded in 
a hard copy of the document image subjected to the scramble 
processing in such a way that the scramble conditions cannot 
be easily seen by the naked eye. Thus, the scramble condi- 
tions are included in the hard copy. The hard copy is 
reproduced by using the scramble conditions restored from 
the hard copy. If a user desires, the scramble processing is 
performed not on a front page, but on the following pages. 
The scramble processing can be performed at different 
levels, and the scramble conditions include a level of 
scramble processing. Preferably, special marks can be reg- 
istered, and a level of scramble processing is also registered 
for each of the marks. If one of the special marks are 
extracted from a document image, the repetition time is 
determined automatically according to the registered data. 
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IMAGING PROCESSOR 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 5 
The present invention relates to an image processor such 

as a printer or a copying machine for preventing leakage of 
secret document caused by illegal copying thereof. 

2. Description of the Prior Art jq 
Recently, copying machines are developed and used 

widely. Then, infringement of copy right and illegal copies 
of secret documents become problems to be solved. An 
apparatus disclosed in Japanese Patent laid open Publication 
2-214262/1990 performs scramble processing and scramble 15 
cancel processing for image data of documents in order to 
prevent leakage of secret documents. In the scramble pro- 
cessing, an image data is converted to coded image data 
which cannot be read and the coded image data is printed, 
while in the scramble cancel processing, coded image data 20 
read from the printed image is converted to original image 
data and the original image data is printed. 

However* each apparatus may use a program of different 
algorithm for scramble processing. In such a case, in order 
to decode coded image data, it is necessary to find an 25 
apparatus having the same scramble program used to obtain 
the coded image data, and this is inconvenient On the other 
hand, if apparatuses installing the same programs for 
scramble and scramble cancel programs are available, this 
situation is convenient for a user, but leakage of illegal 30 
copies cannot be prevented effectively. 

An apparatus disclosed in EPC 39 66 774 performs 
scramble processing of image data stored in an optical or 
magnetic recording medium by using a scramble program 
stored in the medium. If this technical idea is applied to a 
copying machine, the scramble program has to be stored in 
a memory inside the copying machine, similarly to the 
above-mentioned apparatus of Japanese Patent laid open 
Publication 2214264/1990, or in a memory card or the like 
which can be connected to the machine. If a scramble 
program is stored in a memory inside the copying machine, 
the above-mentioned problems occur, while if it is stored in 
a memory card or the like, memory cards or the like have to 
be managed separately, and this is also inconvenient for 
practical operation. 

An apparatus disclosed in Japanese Patent laid open 
Publication 3-85872/199 1 first requests a user to input his or 
her identification TD* number. Then, it converts the image 
data to coded data according to a program in correspondence 50 
to the ID number, and the coded data is printed. When 
document images are decoded, the printed image is allowed 
to be read and restored after the ID number is received. 
However, this apparatus needs management of ID numbers. 
In order to cope with a situation when a user forgets his or 55 
her ID number, a bar code in correspondence to the ID 
number is printed at the same time as the coded data. 
However, because a bar code can be read relatively easily, if 
an ID number is read from an illegal copy, a document image 
may be restored illegally by a different apparatus. Thus, the m 
apparatus has a problem to prevent illegal copies while 
managing ID numbers. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide an image 65 
processor which can prevent an illegal copy of secret 
documents more effectively. 



35 
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Another object of the present invention is to provide an 
image processor hard to cancel scramble processing. 

A different object of the present invention is to provide an 
image processor which does not need to set a level of 
scramble processing for each secret document. 

A still different object of the present invention is to 
provide an image processor which can manage secret docu- 
ments which have been subjected to scramble processing. 

In one aspect of the present invention, an image processor 
comprises a scramble means and a scramble cancel means. 
The scramble means performs scramble processing to 
deform a document image by using scramble conditions by 
rearranging pixel data in the document image read by said 
read means. The scramble conditions are embedded in a hard 
copy of the document image subjected to the scramble 
processing in such a way that the scramble conditions cannot 
be recognized with naked eyes easily. Thus, the scramble 
conditions are included in the hard copy. TTie scramble 
cancel means restores a document image by using the 
scramble conditions restored from the hard copy. If a user 
desires, the scramble processing is performed not on a front 
page, but on the following pages. Alternately, the level of the 
scramble processing on a front page is limited to a low level. 
Ttjus, management of documents becomes easy by using the 
front page which can be read easily. 

In another aspect of the invention, the scramble process- 
ing can be repeated so that a degree of a scale of rearrange- 
ment increases as scramble processing is repeated, and the 
scramble conditions include a repetition times of scramble 
processing. Preferably, special marks, for example, marks 
such as "CONFIDENTIAL" can be registered, and a rep- 
etition time of scramble processing is also registered for 
each of the marks. If one of the special mark3 are extracted 
from a document image, the repetition time is determined 
automatically according to the registered data. 

An advantage of the present invention is that management 
of scramble conditions is easy because they are embedded in 
a hard copy. 

Another advantage of the present invention is that a level 
of scramble processing can be set automatically according 
marks detected from an image data on a document. 

A different advantage of the invention is that documents 
can be managed easily by using front pages which are not 
subjected or subjected to scramble processing of a low order. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects and features of the present 
invention will become clear from the following description 
taken in conjunction with the preferred embodiments thereof 
with reference to the accompanying drawings, and in which: 

FIGS. 1A-1D are diagrams for illustrating scramble pro- 
cessing; 

FIG. 2 is a diagram of an example of an image of a 
character "F* in an image area of 128*128 pixels; 

FIG. 3 is a diagram of the image area shown in FIG. 2 
after scramble processing of second level; 

FIG. 4 is a diagram of the image area shown in FIG, 2 
after scramble processing of third level; 

FIG. 5 is a diagram of an example of block data of first 
and 65-th blocks when binarized data of a digital data is 
divided into 8-bit data; 

FIG. 6 is a diagram of an example of density data of block 
number "1" embedded in an image; 
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FIGS. 7A-7D are diagrams on an image of a character "a" 
embedding a block data; 

FIG. 8 is a diagram illustrating a procedure for embedding 
many block data in a hard copy; 

FIG. 9 is a diagram of an example of an image of a 
document consisting of various densities wherein a digital 
data is embedded; 

FIG. 10A is a diagram for changing the density of a 
document image when the density of the document image 
changes continuously, and FIG. 10B is an enlarged diagram 
of a part of the diagram shown in FIG. 10A; 

FIG. 11 is a diagram of an example of embedding block 
data in parallel to a standard pattern for a document image 
wherein a long data cannot be embedded continuously; 

FIGS. 12A and 12B are diagrams of a part of document 
image where marks such as "SECRET" and "CONFIDEN- 
TIAL" are added; 

FIG. 13 is block diagram of an image processor of an 
embodiment of the invention; 

FIG. 14 is a top plan view of an operation unit; 

FIG. 15 is a main flowchart of a controller; 

FIG. 16 is a flowchart of scramble conditions registration; 

FIG. 17 is a flowchart of mark registration; 

FIG. 18 is a flowchart of copy mode for specified marks; 

FIG. 19 is a flowchart of scramble processing; 

FIG. 20 is a flowchart of embedding information; 

FIG. 21 is a flowchart of generating a digital data; 

FIG. 22 is a flowchart of copy mode for front page; 

FIG. 23 is a flowchart of scramble cancel processing; 

FIG. 24 is a flowchart of image recovery processing; 

FIG. 25 is a flowchart for extracting numerical data of 
characteristic points; 

FIG. 26 is a flowchart of recovering a digital data; and 

FIG. 27 is a flowchart of scramble cancel processing. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 
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Referring now to the drawings, wherein like reference 
characters designate like or corresponding parts throughout 
the views, embodiments of the present invention will be 45 
explained below in the following order: 

(1) Scramble and scramble cancel processings 

(2) Embedding of scramble conditions and the like 

(3) Scramble conditions, scramble code and special copy 
modes 

(4) Outline of image processor 

(5) Details of various image processings 

5.1 Main routine 

5.2 Scramble conditions registration 

5.3 Mark registration 

5.4 Copy mode for specified mark 

5.5 Copy mode for front page 

5.6 Scramble cancel 
(1) Scramble and scramble cancel processings 

Scramble processing denotes a processing wherein an 
image data is converted with a prescribed code program to 
coded image data which cannot be read and the coded image 
data is printed. In the scramble processing, pixel data of a 
document image is deformed according to prescribed rules 65 
of operation to be converted to am image which cannot be 
read. This processing is applied for example to documents 



protected from leakage of secrets. Thus, a hard copy of a 
secret document obtained after subjected to scramble pro- 
cessing cannot be read, and the secrets are protected. In 
order to read the documents subjected-to the scramble 
processing, image data read from the hard copy is restored 
to the original documents. This reverse processing is called 
scramble cancel processing or deseramble processing. 

In the scramble processing of an embodiment of the 
present invention, a matrix of pixel data of a document 
image is divided into minor matrices (or processing block) 
and adjacent four minor matrices are transposed according 
to prescribed rules. This operation is repeated by changing 
a size of the minor matrices, and each operation is denoted 
by a level of scramble processing or a scramble level. The 
scramble level may be changed according to the importance 
of a document to be copied. The size of minor matrices 
increased with increasing scramble level, so that the original 
image data are deformed more with increasing scramble 
level. 

FIGS. 1A-1D show an example of scramble processing 
performed by an image processor of the embodiment. In this 
example, the scramble level is increased from one to three. 
Image data are divided into unit blocks or processing blocks 
and the positions of opposing processing blocks in a unit are 
transposed along diagonal directions. A size of processing 
block is set to have a larger value with increasing scramble 
level. Scramble processing of n-th level is performed on 
image data obtained by scramble processing of (n-l)-th 
level. Scramble cancel processing is performed by scramble 
processings of n-the level, (n-l)-th level, . . . , second level 
and first level on the image data subjected to the scramble 
processing of n-th level. 

As shown in FIG. 1A, an image data consists of for 
example 81 mn*8 pqr pixels, wherein 1, m, n, p, q and r are 
natural numbers, l<l<m<n and 1 <p<q<r. The values 81 ran 
and 8 pqr relate to sizes of processing blocks. That is, 81 
mn=21*2m*2n and 8pqr=2p*2q*2 r, wherein 21 and 2p 
come from a size of processing block of first level, 2m and 
2p come from that of second level and 2n and 2r come from 
that of third level. The above-mentioned inequalities on 1, m, 
n, and p, q, r mean that a size of a processing block increase 
with increasing level of scramble processing. 

It is assumed that a matrix A of pixel data of document 
image consists of elements ag,h (g=l, 2, . . . , 8 pqr; h=l, 2, 
. . . , 81 mn) while matrices B, C and D obtained by the 
scramble processing consists of elements b^, c g h and d, iA , 
respectively. 



50 



55 



60 



and 



(i) 
(2) 
(3) 

(4) 



wherein 

g=l,2, ...,8pqr 

and 

b=l, 2, .... 81 mn. 



In the scramble processing of first level shown in FIG. IB, 
a processing block consists of one pixel, and a unit of four 
adjacent processing blocks consists of 2*2 pixels. The 
positions of opposing processing pixels along diagonal 



03/11/2004, EAST Version: 1.4,1 



5,583,941 



directions in a unit are transposed as shown by double 
arrows. That is, the matrix A has following relations (5) to 
the matrix B: 



wherein 



an- u> 



(5) 



10 



M, 2, . . . , 4pqr 



and 



j=i, 2, 



,4m. 



Scramble processing of second level is performed on the 
matrix B obtained by scramble processing of first level. 
First, as shown in FIG. 1C, the matrix B are divided into 
4mn*4 qr of processing blocks B' consisting of 21*2p pixels. 
The positions of opposing processing blocks B' in a unit of 
four adjacent processing blocks are transposed along diago- 
nal directions. A matrix C obtained by the transposition 
consists of 4mn*4qr processing blocks C each consisting of 
21* 2p pixels, similarly to the matrix B, and the processing 
block C has following relations (6) to the processing block 
B': 



wherein 



and 



2, 



. 4 qr, 



, 4 ma. 



20 



(6) 



30 



35 



40 



Scramble processing of third level is performed on the 
matrix C obtained by scramble processing of first level. 
First, as shown in FIG. ID, the matrix C are divided into 
4mn*4 qr of processing blocks C" each consisting of 2 ln*2 
pr pixels. The positions of opposing processing blocks C" in 45 
a unit of four adjacent processing blocks are transposed 
along diagonal directions as shown by double arrows. A 
matrix D obtained by the transposition consists of 41n*4 pr 
processing blocks D each consisting of 2m*2q pixels, simi- 
larly to the matrix C, and the processing block D" obtained 50 
by the transposition has following relations (7) to the 
processing block C": 



wherein 



and 



=1,2, . 



j=l,2,. 



= CiM 
, 4 pr, 



,4 In. 



(7) 



55 



60 



65 



FIGS. 2, 3 and 4 shows an example of a change of an 
image caused by scramble processing for an image area of 



128*128 pixels. The image area corresponds to an area of 8 
mm square for a sheet of paper of 4A size for resolution of 
400 dots per inch (dpi). FIG. 2 shows an enlarged image of 
an image area of 128* 128 pixels of an original image before 
scramble processing. The image area including a life-size 
character of 'T" is shown at the bottom in FIG. 2. 

In this example of image area, 4*4 pixels are treated in a 
unit or a character image is treated substantially as 32*32 
pixels because such treatment does not deteriorate the char- 
acter image practically. Therefore, scramble processing of 
first level does not change the image because it is performed 
by using processing blocks consisting of a pixel. Even if 4*4 
pixels are not treated in a unit, an image does not deformed 
so largely. 

FIG. 3 shows an image area obtained by scramble pro- 
cessing of second level performed by using processing 
blocks of 4*4 pixels (orl=p=2). It is apparent that the image 
area obtained by this scramble processing can be understood 
easily. Thus, after scramble processing of second level, 
characters in a document image would be read to some 
extent 

FIG. 4 shows an image area obtained by scramble pro- 
cessing of third level performed by using processing blocks 
of 4*4 pixels (or m=q=4). It is clear that the original image 
is deformed largely. Thus, after this scramble processing, 
most of characters in a document image would not be read, 

As explained above, scramble cancel processing denotes 
a processing wherein image data read from a printed image 
which have been subjected to scramble processing is con- 
verted with a prescribed recovery program to original image 
data and the original image data is printed. In the scramble 
cancel processing, the operations which are used for the 
scramble processing is iterated in the reverse order. As to the 
scramble processing shown in FIGS. 2-4, the image data 
shown in FIG. 4 is first read and subjected to scramble 
processing of third level in the same conditions or with 
m=q=4. Thus, the image shown in FIG. 3 is reproduced. 
Next, the image is further subjected to scramble processing 
of second level in the same conditions or with l=p=2. Then, 
an image which has been obtained after scramble processing 
of first level is reproduced. Finally, the image is subjected to 
scramble processing of first level. Thus, the original image 
shown in FIG. 2 can be restored. 

A user can set desired values of 1, m, p and q. Tne values 
of n and r are determined from the four values and the entire 
size of an image. For example, if an image consists of 
4,800*3,200 pixels for a paper size of A4 and a resolution of 
400 dpi, n=75 and r=50. 
(2) Embedding scramble conditions and the like 

When a user sets scramble conditions with an operation 
unit, the image processor embeds scramble information in 
an image after is subjected to scramble processing. The 
scramble information includes scramble conditions, a level 
of scramble processing and a scramble code. The scramble 
code is a code number used to permit scramble cancel 
processing. The scramble information is converted to a 
digital data and the data is embedded in an image as a digital 
data consisting of discrete dots, as will be explained below. 
The scramble conditions includes values of 1, m, p and q of 
2 bytes or so and a level of scramble processing, where the 
values 1, m, p and q represent sizes of processing blocks used 
in scramble processing of second and third levels. The 
scramble code for scramble cancel is expressed as a 4-byte 
data. The level of scramble is represented as a 1-byte data. 

In the embedding of a digital data on scramble informa- 
tion, the digital data has to be embedded so that a person 
cannot recognize it with naked eyes easily. If the digital data 
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cannot be embedded in such a way because of its long 
length, it is divided into blocks of a predetermined length, 
and the blocks are embedded. In this case, a block number 
is added for each block in order to identify a position of a 
block in the digital data. When blocks are read, the blocks 5 
are rearranged in the order of block number. Data of blocks 
which cannot be read are eliminated. 

In the present embodiment, the digital data on scramble 
information is divided into blocks of 8 bits. FIG. 6 shows a 
situation of embedding a block data of the first and 65-th .10 
blocks of a data shown at the upper side in FIG. 6. A block 
number is represented with 7 bits, and a block data of 15 bits 
is defined between recognition codes MSB ("1 1") and LSB 
("01"). When an image is read, if there are found a pre- 
scribed number of pixels between "11" and "01" they are 15 
decided to be an embedded block data. 

FIG. 6 illustrates a situation when a block data is embed- 
ded in an image, one level (say "0") of a binarized data is 
expressed at a density which is the same as those of adjacent 
pixels, while the other level ("1") is expressed at a density 20 
which is different a little from those of adjacent pixels. This 
data is hereinafter referred to as "density data". Further, in 
the example shown in FIG. 6, each density data in a block 
is arranged with a distance of one pixel. A block data 
consists of total 19 bits (=2+7+8+2), and it can be embedded 25 
if there is a line of a length longer than 40 dots, as shown as 
a central horizontal dot line in FIG. 6. The 40 dots has a 
length of Vio inch (about 2.5 mm) for a printer or an image 
reader of a resolution of 400 dots per inch, and black lines 
of such a length may exist in most documents including 30 
characters. That is, an additional data of 40 dots can be 
embedded sufficiently in such a document. 

Next, data conversion on scramble information as a 
digital data into density data and the embedding of the 
density data of blocks in an image in a hard copy is 35 
explained. FIGS. 7A-7D illustrate an example of the data 
conversion and the embedding. FIG. 7A shows an enlarged 
view of a character "a" of a font of 12 point, while FIG. 7B 
denotes an enlarged view of a part of the character "a". In 
this example, a digital data ("1101") is embedded at posi- 40 
lions as shown in FIG. 7C encircled with ovals. The density 
data shown in FIG. 7C is obtained by converting the data 
("1101") shown in FIG. 7D, and they are embedded at a 
constant pitch (pixel distance). 

Block data of a digital data can be embedded in an image 45 
at a desired position irrespective of position and direction of 
density data, and each dot of a digital data is so small not to 
be recognized with naked eyes. Because the embedding 
position of a digital data is not definite, it becomes impos- 
sible for a user who wants to leak secret documents to copy 50 
them by shading the block data embedded in a hard copy 
obtained after scramble processing. 

However, if block data are all embedded in a certain area, 
they may become prominent as noises. Because scramble 
information is desirable not to be recognized by an ordinary 55 
user, it is embedded dispersed in a hard copy. As an example 
shown in FIG. 8, block data are embedded along three 
directions, successively from a comer. Further, in order to 
minimize the possibility of absence of density data for a 
dirty document or for a document prepared as a patchwork, 60 
it is desirable to embed a plurality of sets of the same block 
data repeatedly in a hard copy as shown in FIG. 8. There 
may be a case wherein a part of a digital data is recovered 
erroneously due to dirtiness or the like. In this case, an odd 
number of sets of additional data is embedded in a hard copy, 65 
and an effective data is determined from a decision by 
majority. 



For a document wherein the density of an image changes 
complicatedly, it becomes hard for embedded digital data to 
be recognized from an image. Therefore, a block data is 
embedded at an area wherein the density does not change 
largely. However, a block data can also be embedded over a 
plurality of areas if there is no density change in each of the 
areas for example in two areas as shown in FIG. 9, or if there 
are areas not having a density assigned for the block data. 

In principle, a predetermined density band is assigned for 
density data generated from block data in order to embed a 
digital data. However, as shown in FIGS. 10A and 10B, for 
a half-tone image wherein the density changes continuously, 
the density values are changed for a density band "Wa" 
assigned to density data of block data, as shown enlarged in 
the right side. That is, in density bands "Wb" at both sides 
of the density band "Wa", the slope "1" of reproduced 
density with the image density is changed as slopes "2", or 
the image density of document in the density band "Wa" is 
driven out from the band "Wa". 

A long continuous density data cannot be embedded in 
some figures such as a pattern of parallel narrow lines or the 
like. In FIG. 11, density data can be embedded even in such 
a case by using each pattern itself as a density data to express 
a block data. Further, as shown in FIG. 11, a standard pattern 
may be embedded in parallel to the block data (four dots in 
this example) without using density data for MSB and LSB, 
and a block data as long as the standard pattern can be 
embedded. In this method, though the width is enlarged, the 
length can be shortened. 

By performing the above-mentioned procedure, scramble 
information can be embedded in a document image, and a 
hard copy embedded with the digital data can be printed. 
Because the scramble information is included in a hard copy 
which will be subjected to scramble cancel processing, a 
memory exclusive for managing scramble conditions and a 
scramble code is not needed to be provided in the image 
processor. 

(3) Scramble conditions, scramble code and special copy 
modes 

A user can set scramble conditions. As explained above, 
the scramble conditions include values of 1, m, p and q of 2 
bytes or so for processing blocks and a level of scramble 
conditions. The values 1, m, p and q represent sizes of 
processing blocks used in scramble processing of second 
and third levels. In the present embodiment, scramble con- 
ditions except the level of scramble processing are set as 
numerical values, while the level is set separately. When a 
user sets the scramble conditions, a document image is 
scrambled according to the scramble conditions, and the 
scramble conditions are converted to a digital data to be 
embedded in the image data after scramble processing. 
Then, the image data including the digital data is printed on 
a paper. Because the scramble codes used for scramble 
cancel are also embedded in the printed image as the digital 
data hard to be recognized, it is possible that any among 
image processors can be used to restore the document image. 
Further, the scramble cancel is difficult for a person who 
does not know the scramble conditions, and a secret can be 
protected effectively. 

If a user does not set the scramble conditions, scramble 
processing is performed according to default scramble con- 
ditions. In this case, only the default scramble conditions are 
embedded in a printed image as a digital data. 

In this case, a level for scramble cancel processing is set 
automatically according to an identification (ID) number of 
each user. Scramble cancel processing is carried out only if 
the level for scramble cancel set by the image processor is 
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equal to the level of scramble processing. Thus, the ID 
number is used to manage an access level allowed for the 
user. On the contrary, when a user sets the scramble condi- 
tions, only a limited range of persons who know the 
scramble conditions can cancel the scramble processing. 5 

It is convenient to change a level of scramble processing 
according to attributes of a document. Then, special copy 
modes are provided in the image processor. 

There are different level of secret protection among 
documents. Some documents have to be protected from 10 
leakage very severely, while some may be allowed to be read 
by others in a wide range, for example, in a company. Then, 
in the image processor, the level of scramble processing is 
set according to the degree of secret protection. 

AS shown in FIGS. 12A and 12B, in general, important 15 
documents in an office or the like have marks such as 
"SECRET', "CONFIDENTIAL" or "FOR YOUR EYES 
ONLY" added to a front page thereof. Then, the image 
processor of the embodiment stores data on specified marks 
and can perform scramble processing according to a sped- 20 
fied mark recognized from image data. That is, if a copy 
mode for specified marks is requested by a user, the level of 
scramble processing is set automatically according to one of 
the specified marks if it is recognized in an image data. 
Information on the level of scramble processing is embed- 25 
ded in an image by including it in a digital data as well as 
the scramble informadon explained above. For example, for 
a document including a mark of "CONFIDENTIAL", the 
level of the scramble processing is set as third level because 
documents with the mark have to be protected from leakage 30 
as severely as possible. 

Further, the image processor of the present embodiment 
also has a copy mode for front page. The copy mode for 
front page is provided in order to make it easy to manage 
secret documents easy. The image processor has the auto- 35 
made document feeder 201, and a front page can be decided 
from the order of document data received from the auto- 
matic document feeder 201. In the copy mode, a front page 
is not subjected to scramble processing at all or only to 
scramble processing of first level which deforms the image 40 
data not so largely or allows a hard copy to be read easily. 
In the copy mode, information on the levels of scramble, 
processing of the front page and the following pates is also 
embedded by adding it to a digital data as well as the 
scramble informadon. 45 
(4) Outline of image processor 

FIG. 13 shows a block diagram of a controller of the 
image processor of the embodiment. A keyboard 100 can be 
used to set an ID number of a user, scramble conditions by 
a user and the like, and information from the keyboard 100 50 
is sent to a control section 400. An image input section 200 
comprises an image reader which reads an image of a 
document with a charge coupled device (CCD) sensor. It 
also has a known automatic document feeder 201 for reading 
image data of documents placed therein successively. A 55 
printer section 300 comprises a known electrophotographic 
digital printer which prints image data received from the 
control section 400. The control section 400 performs and 
controls image processing of image data received from the 
image input section 100, including the scramble and 60 
scramble cancel processings. 

Next, blocks included in the control section 400 are 
explained. Scramble conditions registration section 401 
comprises a memory which stores scramble conditions and 
scramble codes and it is accessed on scramble and scramble 65 
cancel processings. Default scramble conditions registration 
section 402 comprises a memory for storing default 
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scramble conditions. User ID registration section 403 com- 
prises a memory which stores ID numbers of users and 
levels of scramble processing being able to be canceled by . 
the users. Scramble section 404 stores a scramble processing 
program which is run according to the scramble conditions 
stored in the scramble reprocessing registration section 401 
or in the default processing registration section 402; 
Scramble cancel section 405 stores a scramble cancel pro- 
gram which is run by using the scramble conditions stored 
in the scramble conditions registration section 401 or in the 
default processing registration section 402 to restore an. 
original image. Data embedding section 406 stores a data 
embedding program which converts scramble conditions set 
by a user and a scramble code to a digital data and embeds 
the digital data in an image. Data restoration section 407 
stores a data restoration program which extracts a digital 
data embedded in a print of an image subjected to scramble 
processing when scramble cancel processing is performed. 
Mark registration section 408 comprises a memory to reg- 
ister marks such as "SECRET" and levels of scramble 
processing for each of the marks. Comparison section 409 
has a comparison program which compares a mark added to 
a document with marks registered in the mark registration 
section 408. An image memory 411 comprises a random 
access memory connected to the image input section 100 
and the printer section 300 and it stores a document image. 
A controller 410 controls the operation of the control section 
400 and timings of the image input section 100 and the 
printer section 300, 

FIG. 14 shows a top plan view of the operation section 
100. When a user want to set scramble conditions, he or she 
first touches a key 105 for setting the scramble conditions 
and then sets scramble conditions with keys 108. When a 
user wants to input scramble codes for canceling the 
scramble processing, he or she first touches a key 106 for 
canceling the scramble processing and then sets scramble 
codes with ten-keys 109 by following instructions displayed 
by an LED display 111 for display. When a user starts 
scramble processing, he or she touches a start key 110 and 
sets a level of scramble processing. Then, the scramble 
processing on a document image is carried out When a user 
wants to start scramble cancel processing to restore an 
original document image, he or she touches a scramble 
cancel key 107 and operates as instructed by the LED 
display 111. Then, the scramble cancel processing is started. 
When a user want to start scramble cancel processing to 
restore a document image with a specified mark, he or she 
touches a scramble cancel key 107 and operates as instructed 
by the LED display 111. 

In order to register marks used in the above-mentioned 
copy mode for specified marks, a user touches mark regis- 
tration key 101 first and a mark is registered. At the same 
time, a level of scramble processing for each registered mark 
is also set with the ten-keys 109. After registering the mark, 
when a user touches a key 102 for the copy mode for 
specified marks, the copy mode is started. If a user touches 
a key 104 for user ID registration, user information can be 
registered. If a user touches a key 104 for the copy mode for 
front page, the copy mode is started. 
(5) Derails of various image processings 

FIG. 15 shows a main flow of the controller 410. First, the 
control unit 400 is initialized (step SI 00), and the entire 
system is initialized (step S101). Then, it is waited that any 
input signal is received from the operation unit 100 (step 
S102). 

If the signal from the operation unit 100 is decided to be 
a request of setting scramble conditions or if the key 105 
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(FIG. 14) is decided to be touched (YES at step S103), 
scramble conditions are registered (step S104), refer also to 
FIG. 16). If the signal is decided to be a request of mark 
registration or if the key 101 is decided to be touched (YES 
at step S105), marks are registered (step S106, refer also to 
FIG. 17). If the signal is decided to be a request of user ID 
registration or if the key 103 is decided to be touched (YES 
at step S107), user information such as user ID numbers and 
levels of scramble processing therefor are registered (step 
S108). If the signal is decided to be a request of copy for 
specified marks or if the key 102 is decided to be touched 
. (YES at step S109), the copy mode is performed (step SUO, 
refer also to FIG. 18). If the signal is decided to be a request 
of copy for front page or if the key 104 is decided to be 
touched (YES at step Sill), the copy mode is performed 
(step S112, refer also to FIG. 22). If the signal is decided to 
be a request of scramble cancel or if the key 107 is decided 
to be touched (YES at step S113), scramble cancel process- 
ing is performed (step S114, refer also to FIG. 23). Other- 
wise, the flow returns to step S102 to process a next input. 

5.2 Scramble conditions registration 

FIG. 16 shows a flow of the scramble processing regis- 
tration (step S104 in FIG. 15). First, scramble conditions or 
values of 1, rn, p and q for processing blocks are set by a user 
with the keys 108 (step S120), and the scramble conditions 
are registered at the scramble conditions registration section 
401 (step S121). Next, a scramble code is prepared accord- 
ing to the scramble conditions (step SI 22), and the scramble 
code is displayed in the LED display 111 (step S123). Then, 
the scramble code is registered at the scramble conditions 
registration section 401 (step S124), and the flow returns to 
the main flow. 

5.3 Mark registration 

FIG. 17 shows a flow of the mark registration (step SI 10 
in FIG. 15) wherein marks as shown in FIGS. 12A and 12B 
are registered. First, the image input section 200 is activated, 
and a document image read for a document which is 
intended to be copied in the copy mode for specified marks 
is received in the image memory 411 (step S130). Next, a 
mark included in the document image data is extracted (step 
S131). Next, a request for setting a level of scramble 
processing for the mark is displayed on the LED display 111, 
and the level set by a user is received (step S132). Then, the 
extracted mark and the level therefor are registered at the 
mark registration section 408 (step S133), and the flow 
returns to the main flow. 

5.4 Copy for specified marks 

FIG. 18 shows a flow of the copy mode for specified 
marks (step SUO in FIG. 15). First, the image input section 
200 is activated, and a document image read for a document 
which is intended to be copied in the copy mode is received 
in the image memory 411 (step S140). Next, a mark included 
in the document image data is extracted (step S141), and a 
search is performed to confirm if the extracted mark is 
included in the marks registered in the mark registration 
section 408 (step S142). 

If the extracted mark is decided to be included in the 
registered marks, a level of scramble processing for the mark 
is searched and set at the scramble section 404 (step S143). 
The program in the scramble section 404 reads scramble 
conditions registered at the scramble conditions registration 
section 401 if they are set by a user, otherwise it reads 
default scramble conditions set at the default scramble 
conditions registration section 402. Then, scramble process- 
ing is performed according to the scramble conditions read 
as mentioned above (step S144). Then, data subjected to 
scramble processing is stored in the image memory 411. On 
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the other hand, if the extracted mark is decided not to be 
included among the registered marks (NO at step S142), the 
flow jumps to step S145 readily. 
At step S145, the printer section 300 is activated to print 

5 the image stored in the image memory 411. If the extracted 
mark is registered, and a hard copy subjected to scramble 
processing at step S144 is obtained, otherwise a hard copy 
of document image is printed without scramble processing. 
Finally, if the document is decided not to be a final page (NO 

10 at step S146), the flow returns to step S140, otherwise the 
flow returns to the main flow. 

FIG. 19 shows a flow of the scramble processing (step 
S144 in FIG. 18 and step S153 in FIG. 22 which will be 
explained later). First, the program in the scramble section 

15 404 reads scramble conditions or values of I, m, p and q at 
the scramble conditions registration section 401 or the 
default scramble conditions at the default scramble condi- 
tions registration section 401 if a user does not set the 
scramble conditions (step S200). On the other hand, an 

20 arrangement of pixel data of the document image read at step 
S140 in FIG. 18 or step S151 in FIG. 22 is expressed as a 
matrix A (step S201). Next, a size of a processing block for 
scramble processing of first level is set. That is, x=l and y=l 
(step S202). The x and y denote a vertical side and a 

25 horizontal side of the processing block having a rectangular 
shape. The values mean that the processing block consists of 
one pixel. Then, transposition of the scramble processing of 
first level explained above is performed on minor matrices 
of the matrix A according to Eqs. (5) (step S203), and a 

30 transposed matrix B is obtained. Next, it is decided if the 
level of scramble processing set at the scramble section 404 
is 1 or not (step S204). If the decision is YES, the flow 
proceeds to step S210 readily to embed scramble informa- 
tion. 

35 If the decision is NO at step S204, scramble processing of 
second level is performed. First, a size of processing block 
for scramble processing of second level is set. That is, x=21 
and y=2p (step S205). Hie values mean that the processing 
block consists of 21*2p pixels. Hien, transposition of the 

40 scramble processing of second level explained above is 
performed on the matrix B according to Eqs. (6) (step S206), 
and a transposed matrix C is obtained. Next, it is decided if 
the level of scramble processing set at the scramble section 
404 is 2 or not (step S207). If the decision is YES, the flow 

45 proceeds to step S210 readily to embed scramble informa- 
tion. 

If the decision is NO at step S207, scramble processing of 
third level is performed. First, a size of processing block for 
scramble processing of third level is set. That is, x=2m and 

50 y=2q (step S208). The values mean that the processing block 
consists of 2m*2q pixels. Then, transposition of the 
scramble processing of third level explained above is per- 
formed on the matrix C according to Eqs. (5) (step S209), 
and a transposed matrix D is obtained. Then, the flow 

55 proceeds to step S210 readily to embed scramble informa- 
tion. 

Finally, at step S210, scramble information is embedded 
in the image data subjected to scramble processing (refer 
FIG. 20), and the flow returns to the main flow. 

60 FIG. 20 shows a flow of embedding a digital data (step 
S210 in FIG. 19). The digital data includes scramble con- 
ditions (values of 1, m, p and q), a level of scramble 
processing and scramble codes if a user sets the scramble 
conditions. First, block data of binary number are generated 

65 by dividing the digital data into blocks of a predetermined 
dot number added with a block number (step S1801, refer 
FIG. 21). Next, in order to embed each block data in a hard 
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copy as shown in FIGS. 6 and 7A-7D, the values of the 
block data are converted into signals of density data (step 

51802) . Then, areas for embedding the block data in a hard 
copy subjected to scramble processing are searched (step 

51803) . Then, if an area as long as a predetermined length 5 
is decided to exist (YES at step S1804) or if an area is 
decided not so long as the predetermined length but it is 
decided to be extensible to an adjacent area because the 
density changes gradually (YES at step SI 805), the posi- 
tions of each dots are determined (step S1805), and the 10 
density values in a density block appropriate for the posi- 
tions are determined for the positions (step S1807). Next, the 
block data determined above are written in the image data 
(step S1808). The above-mentioned processing is repeated 
until all digital data are processed ) YES at step S1809). 15 
Further, the above-mentioned processing is repeated until a 
predetermined number of sets are embedded (YES at step 
S1810). 

FIG. 21 shows a flow of generating data to be embedded 
(step S1801 in FIG, 20). In this flow, block data of binary 20 
number are generated by dividing the digital data into blocks 
of a predetennined dot number added with a block number. 
First, check codes for making it possible to recover embed- 
ded block data and codes for error correction are calculated 
(step S1820), and a total data length of the data to be 25 
embedded is calculated (step S 1821). Further, the bit number 
for dividing the digital data into blocks is calculated and the 
number of blocks is calculated (step S1822). Further, ablock 
number is added to each block data obtained by dividing the 
digital data (step S1823) and the end mark LSB for desig- 30 
nating the start of the block data and the end mark MSB for 
designating the ends of the block data are added (steps 
S1824 and S1825). Thus, a block data as shown in FIG. 5 
can be generated. 

5.5 Copy mode for front page 35 
FIG. 22 shows a flow of the copy mode for front page 

(step S112 in FIG. 15). First, a request is displayed in the 
LED display 111 for setting a level of scramble processing, 
and the level set by a user is sent to the scramble section 404 
(step S150). Then, the image input section 200 is activated, 40 
and a document image read for a document which is 
intended to be copied in the copy mode is received in the 
image memory 411 (step S151). Next, it is decided if the 
document read by the image input section 200 is a front page 
or not (step S152). If the decision is YES at step S152, the 45 
flow proceeds to step S154 without scramble processing. On 
the other hand, if the decision is NO at step S152, the default 
scramble conditions set at the default scramble conditions 
registration section 402 are read. Then, scramble processing 
is performed according to the default scramble conditions 50 
(step S153). Then, data subjected to scramble processing is 
stored in the image memory 411. 

Next, the printer section 300 is activated to print the 
image stored in the image memory 411 (step S154). Then, 
when the document is a front page, an ordinary hard copy of 55 
document image is printed without scramble processing, 
otherwise a hard copy subjected to scramble processing is 
obtained. 

Finally, if the document is decided not to be a final page 
(NO at step S155), the flow returns to step S150, otherwise 60 
the flow returns to the main flow. 

5.6 Scramble cancel 

FIG. 23 shows a flow of scramble cancel processing (step 
S114 in page 15). First, the image input section 200 is 
activated, and a document image is read for a document 65 
which is intended to cancel scramble (step S160). Next, 
scramble conditions and a level of scramble processing are 



restored from the image data read by the image input section 
200 (step S161, refer FIG. 24). Then, it is decided if 
scramble codes are included in the restored data (step S162). 

If scramble codes are decided to be included (YES at step 
S162), a request to set scramble codes is displayed on the 
LED display 111, and scramble codes set by a user is 
received (step S163). Then, it is decided if the restored 
scramble codes agree with those set by the user (step S164). 
If they are decided to agree with each other (YES at step 
SI 64), restored scramble conditions are registered at the 
scramble conditions registration section 401 (step S165). 
Then, scramble cancel processing is performed according to 
the scramble conditions (step S166, refer FIG. 27). The 
scramble cancel section 405 stores data subjected to 
scramble cancel processing in the image memory 411. Then, 
the scramble cancel section 405 stores data subjected to 
scramble cancel processing in the image memory 411. On 
the other hand, if they are decided not to agree with each 
other (NO at step S164), the flow jumps to step S170 readily 
without scramble cancel processing. 

If scramble codes are decided not to be included in the 
restored data (NO at step S162), the scramble processing is 
performed with the default scramble conditions. Then, a 
request to set a user ID number is displayed on the LED 
display 111, and a user ID number set by a user is received 
(step S167). Then, if the level set by the user is compared 
with a level read by the scramble cancel section 405 accord- 
ing to the user ID number (step S168). If the former is equal 
to or larger than the latter of the default scramble conditions 
(YES at step S168), scramble cancel processing is permitted 
(step S169, refer FIG. 27). Then, the data subjected to 
scramble cancel processing is stored in the image memory 
411. Then, the flow proceeds to step S170. 

At step S170, the printer section 300 is activated to print 
the image stored in the image memory 411 is printed. 
Finally, if the document is decided not to be a final page (NO 
at step S171), the flow returns to step S160, otherwise the 
flow returns to the main flow. 

FIG. 24 shows a flow of image recovery (step S161 in 
FIG. 23) where a digital data embedded in a hard copy 
subjected to scramble processing is read out. After tie 
initialization (step S1301), an image data is received (YES 
at step S1302). TTien, the image data are divided into areas 
each for different density distribution in an image (step 
S1303), and coordinates for characteristic points are 
searched (step S1304). A characteristic point denotes a pixel 
having a predetermined density (refer FIG. 6). Further, 
binary numbers are extracted from the characteristic points 
according the predetermined position relation between them 
(step S1305, refer FIG. 25). The binary numbers extracted in 
the unit of blocks are rearranged in the order of block 
number according to a predetermined procedure to recover 
a digital data (step S1306, refer FIG. 26). After the extrac- 
tion of binary numbers is completed, the characteristic 
points are deleted from the image data (step S1307) to 
recover an image data before adding the a digital data. The 
deletion of characteristic points can be performed by replac- 
ing each characteristic point with a density of the pixels 
adjacent to the characteristic point. The extracted digital data 
is sent to the scramble cancel section 405 (step S1308) ). 
Then, the flow returns to step S1302. 

FIG. 25 shows a flow of the extracting numerical values 
from characteristic points (step S1305 in FIG. 24). The 
extraction of binary numbers is performed by judging the 
position relation of characteristic points. In this embodi- 
ment, a block of an additional data is embedded linearly 
within a predetermined range. The embedding may not 
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necessarily be performed in a linear line and may be 
performed for example along an arc if the position relation 
is defined beforehand. 

First, a characteristic point is searched (step S1310) 
Then, all the other characteristic points existing within the 5 
predetermined range are searched (step S1311). The maxi- 
mum length of the predetermined range amounts to the 
length of a block (i.e. the bit length times the bit-to-bit 
distance). Next, it is confirmed if the coordinates of the 
characteristic points have the predetermined position rela- 10 
lion (a linear line in this example) (step S1312), and invalid 
coordinates and data are deleted (step S1313). Then, the 
coordinates of the valid data of a block are converted to a 
binary number (step S1314). Next, if it is decided that the 
binary number has a prescribed number of bits (YES at step 15 
S1315) and that the binary number includes top and last 
recognition bits (YES at step S1316), the binary data is 
stored as a valid data (step S1317). The above-mentioned 
processing is repeated until all characteristic points are 
processed (YES at step S1318). 20 

FIG. 26 shows a flow of the recovery of digital data (step 
S1306 in FIG. 25) wherein the data of the valid blocks 
obtained at step S1305 are converted to a binary data. First, 
the data of the valid blocks are arranged in a row in the order 
of block number included in the data (step S1320). Then if 25 
it is decided that blocks enough at least to recover a digital 
data are available (YES at S1323), the data of each block is 
checked (step S1322). In this embodiment, a plurality of sets 
of an additional data is embedded in a hard copy, and it is 
verified if the data of the same block number are the same 30 
with each other. If the data of the same block number are not 
the same, the data of the majority is adopted. If the data of 
the blocks cannot be determined by the majority decision, 
the data is made invalid. If the number of invalid blocks is 
more than a predetermined number (YES at step S1323), this 35 
means that the hard copy is a forged document made from 
a patch work of a plurality of documents, and the flow 
returns readily to the main flow. If it is decided that the hard 
copy is not a forged document (NO at step S1323), the data 
of the invalid blocks are deleted (step S1324) and the data 40 
of the valid blocks are rearranged to recover a digital data 
(step S1325). Further, imperfect data having defects are 
initialized with predetermined values such as zeros or spaces 
(step S1326). 

FIG. 27 shows a flow of the scramble cancel processing 45 
(steps S166 and step S169 in FIG. 23). First, scramble 
conditions or values of 1, m, p and q at the scramble 
conditions registration section 401 are read or the default 
scramble conditions at the default scramble conditions reg- 
istration section 402 are read if a user does not set the 50 
scramble conditions (step S300). Then, it is decided if the 
level of scramble processing set at the scramble cancel 
section 405 is 3 or not (step S301). If the decision is YES at 
step S207, an arrangement of pixel data of the document 
image read at step S160 in FIG. 23 is expressed as a matrix 55 
D (step S302), and scramble cancel processing of third level 
is performed. First, a size of processing block for scramble 
processing of third level is set. That is, x=2m and y=2q (step 
S303). The x and y denote a vertical side and a horizontal 
side of the processing block having a rectangular shape. The 60 
values mean that the processing block consists of 2m* 2q 
pixels. Then, transposition of the scramble processing of 
third level explained above is performed on the matrix D 
according to Eqs. (7) (step S304), and a transposed matrix C 
is obtained. 65 

Next, scramble processing of second level is performed. 
First, a size of processing block for scramble processing of 



second level is set. That is, x=21 and y=2p (step S305). The 
values mean that the processing block consists of 21*2p 
pixels. Then, transposition of the scramble processing of 
second level explained above is performed on the matrix C 
according to Eqs. (6) (step S306), and a transposed matrix B 
is obtained. 

Next, a size of processing block for scramble processing 
of first level is set. That is, x=l and y=l (step S307). The 
values mean that the processing block consists of one pixel. 
Then, transposition of the scramble processing of first level 
explained above is performed on the matrix B according to 
Eqs. (5) (step S203), and a transposed matrix A is obtained. 
Then, the flow returns to the main flow. 

Next, it is decided if the level of scramble processing set 
at the scramble run section 404 is 1 or not (step S204). If the 
decision is YES, the flow proceeds to step S210 readily to 
embed scramble information. 

If the decision at step S301 is NO, it is decided next if the 
level of scramble processing set at the scramble run section 
404 is 2 or not (step S309). If the decision is YES, an 
arrangement ofpixel data of the document image read at step 
S160 in FIG. 23 is expressed as a matrix C (step S310), and 
the flow proceeds to step S305 to perform scramble pro- 
cessing of second level. 

If the decision at step S309 is NO, the level of scramble 
processing set at the scramble run section 404 is 1. Then, an 
arrangement of pixel data of the document image read at step 
S160 in FIG. 23 is expressed as a matrix B (step S311), and 
the flow proceeds to step S307 to perform scramble pro- 
cessing of first level. 

Although the present invention has been fully described in 
connection with the preferred embodiments thereof with 
reference to the accompanying drawings, it is to be noted 
that various changes and modifications arc apparent to those 
skilled in the art. Such changes and modifications are to be 
understood as included within the scope of the present 
invention as defined by the appended claims unless they 
depart therefrom. 

What is claimed is: 

1. An image processor comprising: 

means for providing digital image data of an image of a 
document; 

scramble means for performing scramble processing on 
said digital image data in accordance with scramble 
conditions to provide first digital data, said scramble 
conditions specifying a manner in which the image is 
enciphered by the scramble processing; 

embedding means for embedding the scramble conditions 
in said first digital data; 

image forming means for forming an image on a hard 
copy from the first digital data having the scramble 
conditions embedded therein; 

read means for reading the image on said hard copy and 
converting said read image to second digital data 
having said scramble conditions embedded therein; 

data restoration means for extracting said scramble con- 
ditions from said second digital data having the 
scramble conditions embedded therein; and 

descramble means for restoring said document image 
from the second digital data by using the scramble 
conditions extracted by the data restoration means. 

2. The image processor according to claim 1, wherein the 
scramble means rearranges pixel data of said document 
image included in the first digital data. 

3. The image processor according to claim 2, wherein the 
scramble means rearranges the pixel data in one of a 
plurality of levels, each of said plurality of levels represent- 
ing a different degree of rearrangement of said pixels, and 
wherein the scramble conditions includes the one level. 
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4. The image processor according to claim 1, further 
comprising operation means for setting the scramble condi- 
tions by a user 

5. The image processor according to claim 1, wherein said 
embedding means embeds the scramble conditions as dis- 5 
crete dots which cannot be easily seen by the naked eye. 

6. The image processor according to claim 4, further 
comprising setting means for setting default scramble con- 
ditions as the scramble conditions when a user does not set 
the scramble conditions. 

7. The image processor according to claim 1, wherein the 10 
scramble conditions include a scramble code, and said 
descramble means restores said document image if the 
scramble code extracted by the data restoration means from 
the second digital data agrees with a code set by a user. 

8. The image processor according to claim 1, further 
comprising registration means for registering identification 
numbers of users, wherein said descramble means restores 
said document image only if an identification number set by 
a user agrees with one of the registered identification num- 
bers. 

9. The image processor according to claim 3, further 20 
comprising registration means for registering identification 
numbers of users and levels permitted for the users, wherein 
said descramble means restores said document image only if 
an identification number set by a user agrees with one of the 
registered identification numbers and the level permitted for 25 
the one registered identification number set by the user is 
equal to or larger than the level included in the scramble 
conditions extracted by said data restoration means. 

10. The image processor according to claim 1, wherein 
said means for providing digital image data includes: ^ 

a read unit for reading said document image and convert- 
ing said document image into said digital image data; 

a document feeder for feeding documents to the read unit; 
and / 

control means for prohibiting scramble processing by said 35 
scramble means for a first document among documents 
fed by the document feeder. 

11. An image processor comprising: 

mark registration means for registering marks to be added 

to an image on a document; 40 
means for providing digital image data of said image of 

said document including any marks added to said 

image on said document; 
extraction means for extracting marks from said digital 45 

image data; 

decision means for determining whether or not to activate 
a scramble means according to a mark extracted by the 
extraction means; 

scramble means for performing scramble processing on 50 
said digital image data in accordance with scramble 
conditions to provide first digital data when said deci- 
sion means determines to activate the scramble means, , 
said scramble conditions specifying a manner in which 
the image is enciphered by the scramble processing; 55 

embedding means for embedding the scramble conditions 
in said first digital data; 

image forming means for forming an image on a hard 
copy from the first digital data having the scramble 60 
conditions embedded therein; 

read means for reading said image on said hard copy and 
converting said read image to second digital data 
having said scramble conditions embedded therein; 

data restoration means for extracting said scramble con- 65 
ditions from said second digital data having the 
scramble conditions embedded therein; and 
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descramble means for restoring said document image 
from the second digital data by using the scramble 
conditions extracted by the data restoration means. 

12. The image processor according to claim 10, wherein 
the scramble means rearranges pixel data of said document 
image included in the first digital data. 

13. The image processor according to claim 12, wherein 
the scramble means rearranges the pixel data in one of a 
plurality of levels, each of said plurality of levels represent- 
ing a different degree of rearrangement of said pixels, and 
wherein the scramble conditions includes the one level. 

14. The image processor according to claim 13, wherein 
said mark registration means registers levels of scramble 
processing for each of the marks registered, and said 
scramble means performs scramble processing on the docu- 
ment image by using the scramble conditions including the 
level registered by said mark registration means in corre- 
spondence to the mark extracted by the extraction means. 

15. The image processor according to claim 11, further 
comprising input means for setting the scramble conditions 
by a user. 

16. The image processor according to claim 15, further 
comprising setting means for setting default scramble con- 
ditions as the scramble conditions when a user does not set 
the scramble conditions. 

17. The image processor according to claim 11, wherein 
the scramble conditions include a scramble code, and said 
descramble means restores said document image if the 
scramble code extracted by the data restoration means from 
the second digital data agrees with a code set by a user. 

18. Hie image processor according to claim 11, wherein 
said embedding means embeds the scramble conditions as 
discrete dots which cannot be easily seen by the naked eye. 

19. The image processor according to claim 11, wherein 
said means for providing digital image data includes: 

a read unit for reading said document image and convert- 
ing said document image into said digital image data; 
a feeder for feeding documents to the read unit; and 
a controller for prohibiting scramble processing by said 
scramble means for a first document among documents 
carried by the feeder. 

20. The image processor according to claim 1 wherein 
said scramble conditions include at least one of either a size 
of processing blocks used in the scramble processing or a 
level of scramble processing. 

21. The image processor according to claim 11 wherein 
said scramble conditions include at least one of either a size 
of processing blocks used in the scramble processing or a 
level of scramble processing. 

22. An image processing method comprising: 

a) providing digital image data of an image of a docu- 
ment; 

b) scrambling the digital image data in accordance with 
scramble conditions to provide scrambled digital image 
data, said scramble conditions specifying a manner in 
which the image is enciphered; 

c) embedding the scramble conditions in the scrambled 
digital image data; 

d) forming an image on an output medium from the 
scrambled digital image data having the scramble con- 
ditions embedded therein; 

e) extracting the scramble conditions from the image on 
said output medium; and 

f) restoring said original document image from the image 
on said output medium by using the extracted scramble 
conditions. 

***** 
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